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P/D:9817844 

A/fntlinH nnd System for Delivering Me dia Selecti ons through a Network 

Field of the Invention 

This invention relates to networked multimedia delivery system. More 
particularly, this invention relates to a media delivery system for delivering media 
selection to a plurality of media client over a hybrid fnulticast/unicast network. 

Background of the Invention 



In a true Video-on-Demand (VOD) system, users are allowed to view any video 
program* at any time and perform any VCR-lilce interactive functions, such as fast 
forward/fast rewind, jump forward/jump rewind, slow motion and pause. It can be easily 
achieved by dedicating a channel to each user. However, mis method is very expensive, 

15 inefficient and not scalable. Thus, multicast delivery is regarded as one of the solutions to 
reduce the cost and increase the scalability of a large-Scale VOD system. A multicast 
Stream can be shared by a large number of users. Unfortunately, it is difficult to 
implement interactive functions for multicast streams. It is a challenging and hot topic in 
recent years as to find out how to Satisfy one user's interactive requests without affecting 

20 other users in the same multicast group, 

Many researches have tried to solve this problem. One of the studies is to provide 
^^ted^gR-tetions4 3 ased-onJhe_hufIer size qfito set-top bW-Mter^ve-fuiictrons- 



such as fast forward can only be performed by using the frames already Stored in-tfae 
b uffer . Thus, a large amount of buffer is needed m ordETttrgelrbette 
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Furthermore, this technique cannot serve certain interactive functions Such as jump 
forward/back-ward which involve a change in the buffer content. In another Study, it is 
proposed that User interactions can be handled by creating a Unicast stream. This new 
stream may be held on till the end of the video. It means that all the users may eventually 
hold an individual stream rather than share the same multicast Stream. Thus* the 
scalability is reduced or many interactive requests may be blocked. Such problems limit 
the usefulness of such systems, particularly in the case when such systems ate 
implemented in metropolitan areas having millions of users. 

Therefore, it is an object of this invention to resolve At least some of the problems 
at set forth in the prior art As a minimum, it is an object of mis invention to provide the 
public with a useful choice. 

Sntnmarv of the invention 

Accordingly, this invention provides a method for delivering media to a plurality 
of media client having a buffer for caching media of a selected media Stream within one 
Stream interval and processing capability for playing the media in a multicast media 
stream through a network, including the steps of: 

generating plurality of multicast media Streams, wherein each multicast 
media stream is repeated at regular stream intervals; 

joining the media client to a selected multicast media stream in response to 
a sp.^nfinft tp.qHiest from the media client; 



caching the buffer of the media client continuously with unplayed media-in- 
the selected multicast media stream; and 



25 
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caching the selected multicast media Streams in at least one interactive 
Server, 
Stich that 

interactive requests including any one or more of pause, slow motion, fest 
; forward, rewind, jump forward, and jump backward, and/or errors in 

playing the media in the media client are handled by the interactive server;, 
the media client is split from the selected multimedia media stream when 
an interactive request is submitted by the media client lasting fat an 
interactive time; 

the media client is merged to the selected multicast media stream after the 
interactive request is performed by comparing multiples of the" stream 
intervals with the interactive time. 



15 



20 



It is another aspect of this invention to provide a system for delivering media 
selection to a plurality of media clients having a buffer for caching media of a selected 
media stream within one stream interval and processing capability for playing the media 
in a multicast media stream through a network, including 

at least one media server for generating a plurality of multicast media 
streams, wherein each multicast media stream is repeated at regular stream 
intervals, and the media client is joined to a selected multicast media 
stream in response to a selection request from the media client 
at least one interactive server for caching the Selected multicast media 
. stream 



such that 
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interactive requests including any one or more of pause, Slow motion, fast 
forward, rewind, jump forward, and jump backward, and/or errors in 
playing the media in the media client are handled by the interactive Server; 
the media client is split from the selected multimedia media stream when 
an interactive request is submitted by the media client lasting for an 
interactive time; 

the media client is merged to the selected multicast media stream after the 
interactive request is performed by comparing multiples of the stream 
intervals -vvith the interactive time. 



ferief description of the drawings 



Preferred embodiments of the present invention will now be explained by way of 
example and with reference to the accompany drawings in which: 
15 Figure 1 shows the overall architecture of the media delivery system of this 

invention. 

Figure 2 shows the media stream scheduling of a particularly preferred 
embodiment of this invention generated by a media Server. 

Figure 3 Shows how the media client mergers back to the multicast media stream 
20 after an interactive operation is performed. 

Figure 4 Shows the pause operations, and Figure 5 shows the corresponding 
change of the media client's buffer during a pause operation. 
Fi g ure 6 shows the d gBp-fcB-ftg^^ 



operation. 
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Figure 7 shows how to detennine the suitable multicast media strain after a fast 
forward operation. 

Figure 8 shows' the difference between play-point for fast forward operation and 
normal play back operation. 

Figure 9 shows the difference between play-point for fast rewind operation and 
normal play back operation. 

Figure 10 Shows hdw to determine the suitable multicast media stream after a 
jump forward operation. 



10 ttetail Description of Prefe fred Rmbodiments 

This invention is now described by ways of example 'with reference to the figures 
in the following sections. List 1 is a part list so that the reference numerals may be easily 
referred to. 



15 



20 



Although the following description refers the media or the media selections to be 
delivered is video, it is expressly understood that media in other forms may also be 
delivered ifi the System of this invention instead of video, for example audio, at their 

cotnbiftation. 

1 . System Architecture 
1,1 OverView 

The-overaH-s^^^ 



is 



shown in Fig.1. The system is composed of four main components: 
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a) at least one media server . The media server may be a stand alone server or 
can be a member of the Video Server Cluster VSC (12) as shown in Fig. 1; 

b) a plurality of media clients (14) being Client Stations CS; 

c) a network (16) which may be presented as a Multicast Backbone Network 
5 MBN (20) and a plurality of Local Distribution Networks LDN (22); and 

d) at least one interactive server (18) being the Distributed Interactive Server 
(DIS), 

Note that tile MBN (20) can use any arbitrary topology that supports the multicast 
protocol. The rittg Structure shown in Fig. 1 is used for simplicity and should not be 
1 0 interpreted that a token-ring network is required for this invention. 

1 p, Video Server blaster VSC (12) 

The role of the VSC (12) is to generate the multicast media streams for the entire 
system. Each VSC (12) consists of at least one and preferably 5 to 15 media servers. The 
1 5 number of media Servers in the cluster may be altered as desired. 

Preferably, each media server stores part of the video content in a simple striped 
format with parity added for forward error correction, like RAID 5. This allows a Simple 
error recovery if the CS (14) missed out one video block out of the parity grotip. Also, 
the entire VSC (12) can still be operational even when some of the media servers are 
20 down, achieving some degrees of fault-tolerance. Other knoWn Stripping scheme may be 

employed in this invention. 

The video blocks sent by the VSC (12) are preferably interleaved randomly to 

fltttoriap-lto^^ ***** secuntyTSm^-l-ockS^ e- 

most likely to drop in a busty manner, by inter leaving the packets sent by the VSC-(l-2-) r 
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missing packets are scattered more evenly. Hence, the simple parity scheme may be able 
to recover most, if not all of the missing packets 

In addition, block interleaving discourages eavesdroppers to capture the video 
blocks for viewing. A pseudo random sequence may be used for generating the random 
5 interleaving: the generating key of the sequence is passed to the CS (14) by a public key 
endyption algorithm during channel establishment. A* a result, the CS (14) can reorder 
the video sequence from the regenerated pseudo random sequence. 

To provide interactive functions to the user, the multicast media streams are 
repetitively started at fixed regular stream intervals, for example, every thirty to sixty 
10 seconds, at the VSC (14) to Serve a plurality of media Streams to the majority of 
customers not performing any interactive functions. The media Stream scheduling Of 
thirty seconds stream interval is shown in Fig.2. 

The Stream interval may be chosen at any desired value basing on the scale and 
the performance of the system (10). However, the stream interval is preferably set at 
15 around 30 - 60 sec, such that the average Start up time may be around 15-30 Sec, which 
is acceptable. Although a large number of multicast media streams are needed, it is 
worthwhile to do so as it can provide a better quality of setvice to users and can reduce 
the buffer requirement at the client side for fully interactive functions. Moreover, With 
more multicast media streams, the number and the holding time of the unicaSt stteams 
20 required for providing interactivity and merging may be reduced. 

] q ntirtnt Station CS (U) 

E ach CS ( U) sh mild ^ve a buffer-that can nordWcuVcontamedHrrme-muMea5^ 



media streams for up to one stream interval of video blocks. For stream interval equals-to-- 
25 30 sec and MPEG-2 video (2 to 4 MOT), that amounts-tc-S^ffl^^imple 
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for ertor correction, such as 10 Servers with 1 as parity, the buffer required is around 15* 
10/9 or 16.7 MB. Therefore 32MB of buffer for each CS appears to be sufficient. 

Other than memory requirement, each CS (14) should have a network connection 
such that the media streams can by delivered to CS (14). The network connection is 
5 preferably broadband network connection which can allow -1.5 to 2 times of the MPEG- 
2 transmission rate. Furthermore, each CS (14) should have enough processing capability 
for playing the media in the multicast media Stream. A low-ehd equipped with Petttiun> 
266 together with a hardware or software MPEG-2 decoder is found to be satisfactory. 

10 1 4 Network (16) 

i 4 1 Multicast Backbone "NJfrfwnrk MBN (20) 

There is no particular requirement oh the underlying network (1 6), othet than that 

it Should be capable of supplying enough bandwidth for delivering the multicast media 

streams to CS (14). In a real-life application, MBN (20) may be responsible for handling 
15 several thousands of multicast Streams fitf distribution to the CS (14) tfaroUgh the LBN 

(22). 

Preferably, the MBN (20) is connected to the LDN (22) by a high-speed router. 
Each router should be capable of nmning the desired multicast routing protocol such as 
PIM, MOSPf, DVMRP etc. Ideally, the MBN (20) should be fault-tolerattt and can be re- 
20 routed to alternate routes when necessary. The current IP over DWDM network proposals 
may be used as they seem to provide such a desirable diarabteristio. In general, the higher 
the bandwidth of the backbone network, the more media sfreams it can serve to the users. 



^ n t retribution N^w»^-< LDN (22) 
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The LDN (22) carries the multicast media streams down to each CS (14), pruning 
the streams down the way whoever they ate not needed. A simple tree network may be 
sufficient for such purpose. 

5 i .5. Distributed Interactive Server PIS (181 

The DIS (18) ate mainly responsible for error recovery and generating unicast 
contents in response to interactive requests submitted by CS (14)> by caching the 
multicast media streams. . Althdugh these functions may be performed by VSC (12), they 
are preferably performed by DIS (1 8) to reduce overall server and network load. 
10 Since each multicast stream provided by VSC Can be viewed by virtually 

unlimited number of users, while unicast stream for interactive functions is not, a 
distributed approach is chosen So that the system is mote scalable. 

One of the functions of the DIS (IS) is handle errors in playing the media in CS. 
(14), including tiansmitting any video blocks tnat the CS (14) has not received. Tvlien the 
15 CS (1 4) failed to reconstruct the missing video block, it sends a teeniest to the Dig for the 
missing video block. 

As-the DIS (18) is distributed and it is closer to the CS (14), the packet delay may 
be minimized and this may imptove the response time of the interactive functions and the 
success rate of f etfanSfnission. The multicast stream provides most of the traffic. It was 
20 found in related studies that less than 2% of users perform inter active functions at one 
time. Therefore, a low-end DIS (18) may be sufficient for the media delivery System 

(10>- 

2. Servioe Provisioning 
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The arcmtecture of media delivery system (10) may provide three distinct services 
Class A, B, and C unified in oiie single framework. 

Class A service is similar to the current cable TV service. User* can watch any 
bioadoast channels in a non-interactive manner. To Support Class A service, the media 
5 delivery system (10) should be capable of supporting hundreds of non-iHteractiVe 
multicast channels. This is provided (as also offered in many other architecture^) by 
standard IP multicast channels over the broadband infrastructure. The key issue to be 
resolved is the handling of error retransmission. In this context, Class A service is 
provided by the VSC (12) using multicast IP streams and distributed to the CS (14) via 
10 the network (16). Error recovery and retransmission may be handled by the DIS (18) at 
each LDtt to improve error retransmission. 

The Class B service aims at supporting limited media (say hundreds of hours of 
MPEC-2 programs) in a fully interactive manner with high user scalability. This i 
provided by the hybrid multicast-unicast Sfreatning technology of this invention that 
15 modest amount of system resources may be required to support a large number of usets. 
This service is particularly desirable for metropolitan areas where millions of users may 
want to See certain media (Such as movie, sports or musical event) without little or even 
no restriction. -In the media delivery system (10) of this invention, several hund-ed. hours 
of video contents (MPEC-2) can be supported cost effectively for mteractive multicast 

20 distribution currently. 

Class B service is the most complicated and will be explained in the sections 

below. 

The Clarr ^ — ™ * "^rin e unlimited cont»^a-fixednitiaberofusers^ 



IS 



a 



This Service concept is similar to mdny existing offerings based on a unique unieast- 
9S stream for each viewer. The service unfartaiiEt^ ^ 
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service provisioning cost is fixed per user and is also fairly high at the current technology 
level. However, when this service is bundled with the previous two DItfA services, there 
may be only a small percentage of the entire viewers requesting for this service, thus the 
overall system cost fhay be reduced drastically- 
5 class C service is handled in the following manner. When a certain CS (14) 

requests for a Class C service, A dedicated interactive request is submitted by the CS (14) 
asking for a dedicated media. The local DIS (18) will first be checked to see if there 
exists a copy of the dedicated media stored at the local cache of DIS (18). If yes, the local 
DIS (18) Will service the request directly by starting a unicast stream. If not, the user 

10 manager will initiate a request to the VSC (12). The VSC (12) will distribute the content 
via a unicast stream to the CS (14) requesting the service, either directly from the VSC 
(12) or indirectly to the DIS (18). Interactivity is handled by the VSC (12) or the DIS 
(18). The cache implemented at the local DIS (18) aims at reducing the number of 
requests to the VSC and the backbone bandwidth required according to the usage 

15 statistics of the media. 

3. Interactive Functions 

Interactive functions, including fast forward, fast rewind, jump forward, arid jump 
backward, for the CS (14) may be performed with a dedicated unicast stream from the 
20 DIS. Such interactive functions are provided in the Class B service. 

In general, when the CS (14) requests an interactive function, the CS (14) will first 
leave the multicast group it currently belongs to, then request a unicast stream to handle 
^^e^er-active-funcdoiis^nA e-^Cl^ finishes th^mtef^tivc^ctionrit^t-tises- 



the unicast stream for normal playback, but at a higher, say -1 .5 to 2X, pump -fate. As-a- 
25 result, the CS-s (14) buffer wxll keep falli ng up .md-ft-wrlH*^^ 
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slots. At that point the CS (14) will close the unicast stream to rejoin & suitable multicast 
gteaM. Although the unicast Stream may he left open, this will increases the network 
load. 

In order to provide a limited amount of media to an unlimited number of users in a 
5 fully interactive manner, the batching concept is utilized in this invention, SO that the 
users may state the Same video Stream at the same time while interactive functions may 
still be performed. This may allow one multicast stream to serve many users and reduce 
both the servet and network. 

Three typed of streams are defined in Class B service: 1) M(i)-Stream - which 
10 Stands for multicast media stream fof normal play starting at the beginning of the i-th 
Stream interval; 2) I-stream - which stands for interactive unicast stream opened for the 
interactive functions requested by any User; 3) J-stream - which stands for merging 
unicast stream used by a user to merge back to the M(i)-streatn. 

When a user engages in an interactive function, a new unicast Stream may be 
15 provided to the user according to what interactive .request is raised. Thus an unicast 
stream is said to have split from the original multicast stream. The splitting operation is 
straightforward as a new unicast stream is provided to handle the requested interaction. 

On the other hand, the merge operation is a lot more complicated and is extremely 
important as it allows a client on a unicast Stream to merge back to the M(i)-stream and 
20 release the I-stream after performing the mtemcuVe function. A ^ 

VOt> interactive feature may be achieved because the merging operation reduces the 
number of unicasf streams. It in turns allows the same number of Streams to serve more 
u se*:' intfr™*™ "^ests . thus better qudfly of re^ 



The architecture of the media delivery system (10) can ensure that all the clients.. 
25 can merge badk to M(i)-stream providcd-ttmlfa^ 
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CS (14) buffer is large enough to hold all the toes ^thin one Stream interval (say 30 - 
60 Sec), 2) the J-stfeam cAn transmit at a higher rate than the M(i) streams aUd therefore 
oatt fill tip the necessary buffer before merging. 

A3 an example., consider a 30-sec MPECM (4.7Mbps) video, the buffet required is 
5 18MB (30*4.7/8). The J-stream is opened as soon as a user has finished all interactive 
functions and returns to normal play. The stream then transmits frames at * faster rate f. 
Since the incoming data rate is faster than the consumption rate r, the buffet will fill up. f 
can be chosen with different value* according to the network architecture. Network with 
more bandwidth can support a larger f, which mean, that the client can metge back to the 

1 0 M(i)-stf eaui ib a shorter time- 

Assume the buffer is being filled up at a fate of (f-r) Mbps. In the worst case* the 

required time T P m to fill up the buffer is, 

m bufferSize x8 
T«fl = — T Se ° 

For an example, if f = 1.5+4.7Mbps, thenT^ = 60Sec . 

Once the buffer is- filled Up, the client must be capable of merging back to a M(i)- 
stream, which is shown in Fig.3. Suppose that aft* some interactive action and J-stream 
transmi^ioh, the buffer has been filled up at an arbitrary time mark 280sec relative to the 
CS (14). The current play-point of the Stream is at 90sec so the CS (14) buffer stores the 
fiames from 90sec to I20s*c of the stream The CS (14) then leaves the as ho 

20 mote data can be stored, thus freeing up a J-stream to serve other users. 

Since the stream interval betwee* the M(i)-streams is the same as the CS buffet 
OTrtrtTC*^^ wir^n^CS^^e-inark-can- 



15 



al wayS be found. Since CS will have to Continue to play frames beyond 
buffered, it.,an merge back to the appropriate M®*6«n^ 
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receive frames at 120** of the M(k)-stream (i.e. at time mark 290sec relative to me CS). 
At that time, 10 seconds of buffet space in CS can be freed as the frames from 90sec to 
lOOsec have already been played. Urns, this client is successfully merged back to the 
Shared M(k)-stredm. 

; The operations of each interactive function that may be preferred to be performed 

in the media delivery system (1 0) of this invention will now be described in the following 
sections. 

Ptev/gtop 

For hottoal play back, the CS (14)' first Sends a play request to VSC (14), then 
joins the multicast media stream and finally wait for VSC video data. While for Stop, CS 
jtist simply tells the VSC and leaves the Selected multicast media stream. During the play 
time, the CS buffer is continuously filled by the media in the Selected multicast media 
stream. 

To improve the benefit of multicast delivery, the VSC (12) preferably waits for 
some time to fill the buffer of the CS (14) before starting a new selected multicast media 
stream when a selection request is raised by the user. 



P&USe 



20 



Pause keeps the play-point at its current position. During Pause, the CS buffer 
continues to receive data from the M(i>stream, while no data is consumed. Thus, data 
will accumulate at the buffer. if hotmal-pky is resumed before the CS buffer is full, the 
CS" (14) «m continue to receive data m ^^-^^^^^T^^^^ 



25 position in the buffer is changed. If PaUse continues until buffer is full, the CS (L4)_daes. 
not hlng after the butter is fittefriaprtt^^ 
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Resume is activated, it will try to find the appropriate M(i>stream to merge, The merge 
operation is the same as what has been described in Section C. Suppose the original 
stream is M(k) and the Pause time is T PbuSc . The algorithm is as follows: 

Ifm* stream interval < Tp BUse 
< (m+ IJx stream interval, 
then merge to M(k+ m) stream 

5 Where m should normally be positive as the CS (14) rejoin* the later multicast streams for 
it to maintain the same position in the video. When the play-point is paused near the end 
of the stream and the pause time is large, there may be a wrap around of the streams and 
in can take on negative values. 

10 Slow Motidti 

Slow Motion is to play a Stream at a slower speed, e.g. 0.5X During the slow 
motion, data consumption fate is smaller than the arrival rate. Thus data will be 
accumulated in the buffer. Similar to pause, if playback is resumed before the CS buffer is 
full, the CS (14) can continue to receive data from that M(i)-stream. If slow motion 
15 continues until the buffer is full, the CS (14) must leave the current M(i)-Stream. CS (14) 
will continue to play slow motioh up to the end of the buffer. Then CS (14) Heeds to join 
the next stream in order to get the requited frame for continuing the slow motion. It is 
also becessary for the CS (14) to join the next stream So it.ca* resume normal play at any 



time. 



20 



The CS (14) buffer state shown in Figure 6 helps to explain how slow motion 

-^arwat^^ 1116 fflMI 



' w** — J 

relative to the CS (14). In Figure 4, Slow Motion at 0.5X begins at CS 30sec. After***;- 
frames of 5 second, Be Rayed in every 10 seconds of CS Ume. However, U W iucodw; 
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frame fate is unhanged. Thus, frames of 5 seconds ate accumulated in every 10 seconds 
of CS time, The buffer will be full at SOSeC ahd the CS (14) must leave the current M(k)- 
stream, Then the CS (14) joifcs the next M(k+l)-stteam to get the missing frames after 
gOsec. Since every- stream is separated by the same stream interval 30sec, the fratae* after 
80sec from M(k+1)-Stfeam will be available at CS llOSee. Tbe frames received before CS 
llOseo duplicate with those in the buffet and will be discarded. At CS 120 sec, the CS 
(14) resumes normal play. The play-point position will change to the new M(k+l)-stream 
because the old frames have already beetl played out and the CS (14) resumes hotmal 
play With the incoming frames from the new M(k+l)-stream. 



S peed Fast Forward / F *«* Unwind (TF/RBW) 

Fast Forward FF or Fast Rewind REW is to play frames faster than the normal 
speed, In operation, the CS (14) first tries to use the frames in its own buffet to Serve FF 
by slapping Some of the frames. If the FF action exceeds the range of the frames in buffer, 
1 5 video provided by the I-stream, which is pfe-reoorded at different speeds fot both forward 
and teverse direction FF/REW, is utilized. This Scheme not only u*a bandwidth more 
efficiently, but also provide* various speeds for FF/REW actions (e.g. IX fot rewind, 2X, 
4X, etc) which are offered in advanced VCR. 

The I-streams containing the prerecorded media are generated and provided by the 
20 DIS (1 8) to the CS (14), For example, when a user requests a 4x FF, the DlS sends the 
pre-record 4X forward I-Stream containing video starting at the required time to the CS 
(14). CS (14) may men play out me frames Without wasting atay bandwidth. When the 
^S^nds^eJnteracliye^ctio n afad resumes me normal play, all-Q^t h-e-CS-bufferi^ 



cleared as they are no longer valid Then, a ^stream is sent by the DIS (1 8) to transmit- - 
Y 5 data at a faster' rate to the C STJT T, to t il l up ffi ^iger^^ 
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mentioned in previous sectioii. 

In order to know which packet tike J-stream should carry in order to match the 
play-time, the required packet sequence ntimber p should be Set equal to (playtime x 
{rahoinission fate of M(i>streata)/x, where x is the packet size in bit. 
5 Figure 7 shows how to determine the suitable M(i)-streaw after FF. It can be 

realized that the actual play-time for, say, a 20-seconds 4X FF is 80 seconds. T* is the 
time for FF action and T M i is the same as defined previously. The play-time has gone for 
(Pmc - Pff), where Pff is the play-time to begin FF and Vuc is the play-time to resume the 
normal multicast M(i)-stream, (Tff + T PU l ) is the total time for the split and merge 
10 operation. Thus, the stream hag been played for a time (Tff + ?m )- I* Figu» *> 

shows the difference between play-poiiit for !¥• operation and normal play back 
operation, it is shown that [ (? m *t„)-(fy + T M )] is the playtime of the new multicast 
stream ahead of the play-time of the original multicast stream. Suppose the CS is 
originally in the M(k)-stream. The algorithm for FF operation is as follows: 

If mx stream interval < (P MC - P F f )~ ( t ff + ^psu) 
< (m+ j )x stream interval 
then merge to M(k-m) stream 

where m should be positive as it heeds to go to the previous stream in order to get to the 
later part of the viewing. 

For REW, the operation is similar to FF. It will bring the play-time backwards. 
The DIS will send a pTe^reoord 1X/2X/4X" reverse I-StreaM to CS and J-Stream is also 
20 used to fill-up the buffer for merging. However, referring to Fig- 9, now [Tff + Tru + 
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The algorithm for REW operation is as follows: 
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Ifmx stream Interval ^ + Tfui + 0? ~ ?mc) 
< (zzt+ 1 )*■ stream mteryal 
then merge to M(k± m) stream 

Where ifa should be positive in order to go to later stream for the - earlier part of the 
viewing. 

5 finH fl PorvrirH/Jump Bac kwardfJF/JB ) 

Jump Forward is to go to a specific jplty time immediately. It is an advanced 
feature in VCD and DVD players which allows user to search frames by directly gomg to 
that play-time. 

10 When a user issues a JF tequest in the media delivery system (10) of this 

invention, it will first determine whether the target time frame is in the CS buffer. If yes, 
the user can be served by just moving the pinpoint position in the buffer to the required 
frames. If no, a J-stream beginning at the ^quired time be sent immediately from the 
DBS. The dS clears (CS) its own buffer and plays frames from J-stream. It accepts the J- 
15 stream until the butter is full, then leaves the J-stream and merges back to a M(i)-stream. 

Figure 1 0 shows a particular example where a user jump forward from the 70Scc 
time mark to the 130sec time mark. Pjf is the time when JF starts. Just like the other 
interactive functions, the CS needs to find the suitable M(i>sfream for merging back, The 
algorithm is similar to FF: 

Ifmx stream interval < (P MC -Pjy )- T m 
< (m+ 1 M stream interval 
^° then merge to M(k*m) stream 



where m should be positive as it requests the lafer ptft of the vieWiftg by jumping ; back 

-to^e^r-evious-StreanL — 
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The JB operation is similar to JF, except that JB will jump to a play-tithe at the 
earlier part of the viewing. 

7/\zz2x stream interval ^T m ^ (P m ~ P MC ) 
< (m+ 1 Jx stream interval 
then merge to M(k+ m) stream 

whete m should be positive as it requests the earlier patt of the viewing by 
5 jumping to the later stream. 

It has long been a difficult problem to provide fully interactive functions in a 
multicast VOD system. The media delivery system (10) of this invention may allow the 
tisef to perform fully interactive functions including pause, slow motion, fast 
10 forward/tewind, jump forward, and jump rewind which require a relatively low system 
resources to function. This may be achieved by limiting the number of unicaSt media 
streams during the operation of the interactive functions. Therefore, the overall costs of 
ownership of such VOD systems providing interactive functions may be reduced. 



15 
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While the preferred embodiment of the present invention has been described in 
detail by the examples, it is apparent that modifications and adaptations of the present 
invention will occur to those sldlled in the art. It is to be expressly understood, however, 
that such modifications and adaptations arc within the scope of the present invention, as 
set forth in the following claims. Furthermore, the embodiments of the present invention 
shall not be interpreted to be restricted by the examples or figures only. 
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r.LAlMS: 

1 . A method for delivering media to a plurality of media client having a buffer for 
caching media of a selected media stream within one stream interval and 
5 processing capabiUty for playing the Media in a multicast media stfeam through a 

network, including the steps of: 

generating plurality of multicast media streams, wherein each multicast 
media stream is repeated at regular Stream intervals; 
. ' joining the media client to a selected multicast media stream in response to 
10 a selection request from the media client; 

caching the buffer of the media client continuously with unplayed media in 
the selected multicast media stream; and 

caching the selected multicast media Streams in at least one interactive 
server, 

15 such that 

interactive requests including any one or more of pause, slow motion, fast 
forward, rewind, jump forward, and jump backward, and/or errors in 
playing the media in the media client are handled by the interactive server; 
the media client is split from the selected multimedia media stream when 

20 an interactive request is submitted by the media client lasting for an 

interactive time; 

the media client is merged to the selected multicast media stteam after the 
interactive reqa e?ris-pcr^^ 



25 



intervals with the interactive time. 
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2. 



The method of Claim 1. herein the media client is merged to the selected 
multicast media stream in response to the pause interactive request lasting, for a 
pause time according to the following algorithm: 

If tax stream inter/al < T Pamc 
<(m±l)* stream interval, 
then merge to M(k+ m) stream 

where MOO is the selected multicast media stream, Tp^c is the pause time, and m 
is a positive integef. 



3. The method of Claim 1, wherein media client pldys the media at a slower speed in 
response to the slow motion interactive request, and joins the selected multicast 
media stream after all of the media in the buffer is played. 

4, The method of Claim 1, Wherein at least one unicast media Stream is generated 
from the interactive server and delivered to the media client in response to a fast 
forward, rewind, jump" forward, or jump backward interactive request from the 

15 media client. 

5> The method of Claim 4, wherein an interactive unicast media stream is generated 
from the cached and selected multicast media stream in the interactive server to 
the client containing media at a requested speed in forward or reverse direction in 
20 response to a copending fast forward or rewind interactive request from the 

m ^ H en^and-contammg^^ starting at the ^^tribe^cZ ve- 



request is generated from the media clierit. 



2 \ SJjocifioalioii 

IP\TOMA\ \0020l52fi.doc 



Cb) T£t70 0T82 2SS+ SWOOWBa 8£:8I " D^CT ' F. I 



•[£899 IH/IX Ji) *^ : TT HHK 00. ZT/CT PCT/l B00/0 1 858 

P/D:9817844 

6 . fte method of CUm 5 turther including the step of generating a merging .«M 
media rteam &om the cached and Selected multicast media stream in the 
interactive server to the client staining media starting at the time when the 
interactive request is terminated, wherein the merging unfaast media stream 
s tansttits media at a rate higher than the selected multicast media stream, such that 

the media client merges to the selected multicast media stream after the toteractive 
request is performed. 
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7. 



^ method of Claim 6, where* the interactive request it a fast forward 
inactive request, and the media client is merged to the Sublet* Selected 
multicast media stream according to the following algorithm: 

Ifm* stream interval <, (P MC )~ ( t ff + ^fjvJ 
< (m+ 1 Jx stream interval 
then merge to M(k-m) stream 

where M0O stream is the selected multicast media stream before the fest forward 
motive request is submitted by fce media client, P* is the playtime to begin 
fast forward operation, Pmc 1h the play-time to resume the nottnal multicast media 
stream, Tpp is the time for the fert forward operation, T FJ!1 is fne time required to 
fill th 6 buffer by the merging uhicaat media stream, and m is a positive integer. 

The method of Claim 6, wherein the interactive request is a rewind interactive 
request, and the media client is merged to the subsequent selected multicast media 
^ 6 ^ G cordingJtc^the_fQllp^g^ggnto 
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If mx stream interval ^ T pe + 7^ + ^ w - Pmc) 
< (m+ 1 Jx stream interval 
then merge to M(k+ m) stream 

where M(k) stream is the selected multicast media Stream before the fast forward 
interactive request is submitted by the media client, is the play-time to begin 
rewind operation, Pmc is the play-time to resume the normal multicast media 
Stream, is the time for the rewind operation, T«fi is the time required to fill the 
buffer by the merging unioast media stream, and m is a positive integer. 

The method of Claim 6 further including the step of terminating the interactive 
unicast media stream at the time when the interactive request is terminated. 



10. The method of Claim 4, wherein a merging unicast media stream containing 
media starting at a requested jumping time is generated from the interactive server 
and delivered to the media client in response to a jump forward of jump backward 
interactive request such that the media client merges to the selected . multicast 

1 5 media stream after the interactive request is performed. 

11. The method of Claim 10, wherein the interactive request is a jump forward 
interactive request, and the media client is merged to the Selected multicast media 
stream according to the following algorithm: 

ffm* stream interval £ (P MC -Pj* )~ t foi 
<r- (m+ i)x stream interval 



-20- 



then merge to M(k-m]rstream~ 
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where M(k) stream is the selected multicast media Stream before the fast forward 
interactive request is submitted by the.media client, P JP is the play-time to begin 
jump forward operation, P M d is the play-time to resume the normal multicast 
media Stream, T* is the time for the jump forward operation, T M is the time 
5 required to fill the buffer by the merging Utticast media stream, and to is a positive 

integer. 

12. The method of Claim 10, whereiil the interactive request is a jump forward 
interactive request, and the media client is merged to the selected multicast media 
1 o stream according to the following algorithm; 

If tax stream interval <> T m + (P m - P Mc ) 
<(m+l)x stream interval 
then merge to M(k+m) steam 

where M(k) Stream is the selected multicast media Stream before the fast forward 
interactive request is submitted by the media client, Pjb U the play-time to begin 
jump backward operation, P M c is the play-time to resume the normal multicast 
media stream, T* is the time for the jump backward operation, T Fl u is the time 
required to fill the buffet by the merging unicast media stream, and m is a positive 
integer. 



13. 



A system for delivering media selection to a plurality of media clients having a 
buffer for caching media of a selected media stream vritMn one stream interval 
-and-pmcess^^^ *» a taultkaSt 



through a network, including 



24 Specification 

ipvtoMM \ooao j s2i,6t>o 

SP/££'d £i78'0M (tO T£t70 0182 SNOOtGQ 6£:ST 0002'D3a"£I 



♦ [S8S9 XH/IX Ji) *Z ; TT H3K 00, 2T/ET 



PCT/IBOO/01858 



P/D;9fcl7844 



10 



15 



at least one media server for generating a plurality of multicast media 
streams, wherein each multicast media sttaani ifl Repeated at regular Stream 
intervals, and the media client is joined to a selected multicast media 
stream in response to a Selection tequest from the media client 
at least oUe interactive Setvet for caching the selected multicast media 



stream 



such that 

interactive requests including any one or more of pause, slow motion, fast 
forward, rewind, jump fofward, and jump backward, and/or ettoK in 
playing the media in the media client are handled by the interactive server; 
the media client is split from the selected multimedia media stream when 
an interactive request is submitted by the media client lasting for an 
interactive time; 

the media client is merged to the delected multicast media stream after the 
interactive request is performed by comparing multiples of the Steam 
intervals with the interactive time. 



14 . metnod of Claim 13, where* tf» media client is merged to the selected 

multicast media Stream in icspofi* to the pause intetactive. request lasting for a 
20 pause time according to the following algorithm: 

Ifm* Stream interval < 
<(m+J)x stream interval, 
jken-mergeJ:oJ$[Q&Mz* eain 



where MOO is the selected ***** media stream, T« is the pause time-, attHr 

- -is-a-positive--iixtefiet. .. 
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15. The method of Claim 13, wherein media client tlays the media at a .lower .peed 
to response to the slow motion interact request, and joins the selected multicast 
media Stream after all of the media hi the buffer is played. 

16. The Ihethod Of Claim 13, wherein at least ohe unicast media stream is generated 
fiom the interactive Server and delivered to the media client in response to a fast 
forwatd, rewind, jump forward, of jutitf backward interactive request from the 
media client. 



17, The method of Claim 1 6, wherein an interactive unicast media stf earn is generated 
from the cached and .elected multicast media stream in the interactive serve, to 
& client containing media at a requested speed in forward or reverse direction in 
response to a corresponding fast forward of rewind interactive request from the 

16 media client, and containing media Starting at the time when the interactive 

request is generated from the media client 

18, The method of Claim 17, whetein a merging unicast media stream is generated 
from the cached and Selected multicast media stream in the interactive Server to 
me plient containing media starting at the time when *e interactive request is 
terminated, wherein the merging unicaSt media stream transmits media at a rate 
higher to the selected multicast media stream, such that the media client merges 
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19. 



The method of Claim -18, herein the interactive request is a fast forward 
interactive request, and the media client is metged to the subsequent selected 
multicast media stream according to the Movving algorithm: 

If 222 x stream internal < (P^c ' p ff )~ (?ff + T m ) 
< (m+ 1 )*> stream interval 
then merge to M(k-m) stream 

where M(k) stream is the selected multicast media stream before the fast forward 
interactive request is submitted by the media client, is the play-time to begin 
fast forward operation, Pmc i- the play-time to resume the normal multicast media 
Stream, T F p is the time for the fast fowatd operation, Tm is the time touted to 
fill the buffet by the merging unlcaSt media stream, and m is a positive integer. 



20. The memod of Claim 1 8, wherein the interactive request is a rewind interactive 
request, and the media client is metged to the subsequent selected multicast media 
stream according to the following algorithm: 

Ifmx steam interval ^ T FF + T m + (Paew~ p mc) 
<(m+l)x stream interval 
then merge to M(k±m) stream 

15 where M(k) stream is me select multicast media stream before the fast forward 

interactive request is submitted by the media client, Prsw is the play-time to begin 
*wind operation, P M c i< the play-time to resume the ndrmal multicast media 
stream, T* is the time for the rewind operation, is the time requited to till the 
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21.. The method of Claim 18 further ihcludihg the step of tetminating the interactive 
unicast media stream at the time when the interactive request is terminated. 



15 



20 



22. 



10 23. 



The method of Claim 16, whereiti h merging unicart media stream cotttaihing 
media starting at a revested jumpihg time is generated from the interactive server 
and delivered to the media client in response to a jump forward jump backward 
interactive request such that the tneuia client merges to the selected multicast 
media stream after the interactive request is performed. 

The method of Claim 22, wherein the interactive request is a jump forward 

interactive request, and the media client is merged to the selected multicast media 

stream according to the following algorithm: 

Ifm x stream Interval £ (P MC - P JF )~ t fm 
< (m+ 1 Jx stream interval 
then merge to M(k~m) stream 

where MOO Stream is the selected multicast media stream before the fast forward 
interactive request id 3Ubinitted by the media client, P* is the pldy-time to begin 
jump forward operation, ft* ii H» P^-time to resume the normal multicast 
media stream, Tff is the time for the jump forward operation, T«, is the time 
required to fill the buffer by the merging unioast media stream, and rh is a positive 
integer, 

tractive request, and to media client is merge* to the selected multicast media___ 
stream a cc ording to-ihe^owm^g^h^ 
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Zfmx stream interval £T m + (P m - P M c) 
< (m+ 1 )x stream interval 
then merge to M(jk+ m) Stream 

where MOO ^eam is the selected multicast media stream before the &xt forward 
interactive request is submitted by the media client, P* is the playtime to begin 
jump backward operation, P M c is the play-time to resume the normal multicast 
media stream, T FF is the time for the jump backward operation, T FjU is the time 
required to fill the buffer by the mergulg unicast media stream, and! m is a positive 
integer. 
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Abstract 

In a tegescale video-on-demand (VOD) system, the scalability a*d the provision of 
truly interactive functions are two difficult problems which have not been reeved 
satisfactorily. It is easy to provide My inactive functions using tinicaSt streams but 
these systems are limited in their scalability which affect the cost of service provisioning. 
Batching systems based on multicast streaming, on the other hand, can increase the 
scalability but it is difficult to provide interactive functions on these systems, this 
invention provides a media delivery system having a novel architecture aiming at Serving 
millions of Users in a metropolitan area. It features hybrid multicast-unioaSt Streaming to 
achieve both Scalability and full interactivity through the provision of distributed 
interactive servers, which cached the multicast media streams generated by the niedia 
Servers. The interactive servers may also provide fault tolerant routing and error recovery. 
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